Variable projections neural network training
نویسندگان
چکیده
8 The training of some types of neural networks leads to separable non-linear least squares problems. These problems may be 9 ill-conditioned and require special techniques. A robust algorithm based on the Variable Projections method of Golub and Pereyra 10 is designed for a class of feed-forward neural networks and tested on benchmark examples and real data.
منابع مشابه
Deep neural networks for time series prediction with applications in ultra-short-term wind forecasting
The aim of this paper is to present deep neural network architectures and algorithms and explore their use in time series prediction. Existing and novel input variable selection algorithms and deep neural networks are applied for ultra-short-term wind prediction. Since gradient-based optimization starting from random initialization often appears to get stuck in poor solutions, recent research e...
متن کاملA conjugate gradient based method for Decision Neural Network training
Decision Neural Network is a new approach for solving multi-objective decision-making problems based on artificial neural networks. Using inaccurate evaluation data, network training has improved and the number of educational data sets has decreased. The available training method is based on the gradient decent method (BP). One of its limitations is related to its convergence speed. Therefore,...
متن کاملComparison of artificial neural network with logistic regression in prediction of tendency to surgical intervention in nurses
Introduction: Logistic regression is one of the modeling methods for bipartite dependent variables. On the other hand, artificial neural network is a flexible method with the least limitation. The importance of growing unnecessary beauty surgeries and the importance of prediction and classification made us consider the present study, with the aim of comparing logistic regression and artificial ...
متن کاملProblems and Solutions of Visualizing and Analyzing Multidimensional Output from MLP Networks - Barycentric Projections
Barycentric plotting, achieved by placing gaussian kernels in distant corners of the feature space and projecting multidimensional output of neural network on a plane, provides information about the process of training and certain features of the network. Additional visual guides added to the plot show tendencies and irregularities in the training process.
متن کاملEvolutionary Algorithms – Development and Application to Hydrological Variables Forecasting
A comparison of methods to avoid overfitting in neural networks training in the case of catchment runoff modeling. evolutionary computation techniques for noise injected neural network training to estimate longitudinal dispersion coefficients in rivers. Expert Systems with Applications 39, 1354-1361.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Mathematics and Computers in Simulation
دوره 73 شماره
صفحات -
تاریخ انتشار 2006